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Abstract 

In this paper we consider the continuous-time nonlinear filtering problem, which has an 
infinite-dimensional solution in general, as proved by Chaleyat-Maurel and Michel. There 
are few examples of nonlinear systems for which the optimal filter is finite dimensional, 
in particular Kalman's, Benes', and Daum's filters. In the present paper, we construct 
new classes of scalar nonlinear filtering problems admitting finite-dimensional filters. We 
consider a given (nonlinear) diffusion coefficient for the state equation, a given (nonlinear) 
observation function, and a given finite-dimensional exponential family of probability 
densities. We construct a drift for the state equation such that the resulting nonlinear 
filtering problem admits a finite-dimensional filter evolving in the prescribed exponential 
family augmented by the observaton function and its square. 

keywords Scalar Nonlinear Diffusion Processes, Finite Dimensional Families, Exponen- 
tial Families, Stochastic Differential Equations, Scalar Nonlinear Filtering Problem, Finite- 
Dimensional Filters. 



1 Introduction 

In this paper we consider the (scalar) nonlinear filtering problem in continuous time. For a 
quick introduction to the filtering problem see Davis and Marcus (1981) [10]. For a more 
complete treatment see Liptser and Shiryayev (1978) [15] from a mathematical point of view 
or Jazwinski (1970) [13] for a more applied perspective. 

The nonlinear filtering problem has an infinite-dimensional solution in general. Construct- 
ing nonlinear systems for which the optimal filter is finite dimensional is a problem which 
received considerable attention in the past. It turned out that such systems are quite rare. 

* Available also at www.damianobrigo.it. Part of this paper has been published in "Statistics and Probability 
Letters" 49 (2000), pp. 127-134. 

tA short version co-athored by Francois Le Gland has appeared on the proceedings of the conference 36th 
IEEE CDC San Diego, http://www.irisa.fr/sigma2/legland/pub/cdc97-fdf.pdf 



Examples were given by Benes [1] and Daum [9]. Instead, general results on nonexistence of 
such systems, based on Lie-algebraic techniques, were made available by Chaleyat-Maurel and 
Michel (1984) [8], and related works appeared for example in Ocone and Pardoux (1989) [16], 
Levine (1991) [14]. In the present paper, we construct scalar nonlinear filtering problems ad- 
mitting finite-dimensional filters. Our examples can be added to the contributions of Benes 
and Daum of known examples of finite dimensional filters. The solution of the filtering prob- 
lem is a Stochastic PDE which can be seen as a generalization of the Fokker-Planck equation 
expressing the evolution of the density of a diffusion process. This filtering equation is called 
Kushner-Stratonovich equation, and an unnormalized (simpler) version of it is known as the 
Duncan-Mortensen-Zakai Stochastic Partial Differential Equation (DMZ-SPDE). It is this sec- 
ond equation that we shall consider in the present article. In [7] and [5] the Fisher metric is 
used to project the Kushner-Stratonovich (or the Fokker-Planck) equation onto an exponential 
family of probability densities, yielding the new class of approximate filters called projection 
filters. In [3, 4] the Gaussian projection filter is studied in the small-noise setting. The results 
given in the present paper originate from ideas expressed in such past works, especially in [5] 
and [6]. 

Our approach to the construction of nonlinear filtering problems admitting finite-dimensional 
filters is the following. We model the state according to a SDE whose drift may depend on 
the observations. We consider a given (nonlinear) diffusion coefficient for the state equation, 
a given (nonlinear) observation function, and a given finite-dimensional exponential family of 
probability densities. We construct a drift for the state equation such that the resulting nonlin- 
ear filtering problem admits a finite-dimensional filter evolving in the prescribed exponential 
family augmented in a particular way (depending on h). 

2 Problem formulation 

We start by introducing the filtering problem for scalar continuous time systems. 

On the probability space (f2,jF, P) with the filtration { T t , t e [0 T] } we consider the 
following scalar state and observation equations: 

dX t = f t (X t ,Y t )dt + a t (X t )dW t , X , 

(1) 

dY t = h(X t )dt + dV t , Y = 0. 

We set 

a t {-) :=a t (-) 2 . 

Time invariance of h is needed to simplify exposition. The reason why we require it will result 
clear later on. These equations are Ito stochastic differential equations (SDE's). We shall use 
both Ito SDE's (for example for the signal X) and McShane-Fisk-Stratonovich (MFS) SDE's 
(when dealing with densities). The MFS form will be denoted by the presence of the symbol 
'o' in between the diffusion coefficient and the Brownian motion of a SDE. The noise processes 
{W t , t e [0T] } and {V t , t e [0T] } are two standard Brownian motions. Finally, the initial 
state X and the noise processes {W t , t e [0 T\ } and {V t , t e [0 T] } are assumed to be 
independent. 

Notice that this model is different from the models given usually (Jazwinski [13], Davis and 
Marcus [10]) due to the presence of Y t in the drift f t of the state equation. However, this does 
not complicate matters. Indeed, in [15] a general formulation is given of which our model is a 
particular case. See also, for example, the application of SPDEs theory to filtering [11], where 
the used model class allows dependence of the coefficients /, a and h on the observation process 
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Y. Such models are often encountered in stochastic control, see for example the model (8.1.5), 
(8.1.10) in [2]. The nonlinear filtering problem consists in finding the conditional probability 
distribution iv t of the state X t given the observations up to time t, i.e. 7T t (dx) := P[X t G dx \ y t ], 
where y t := a(Y s , < s < t). We shall say that a filtering problem such as (1) satisfies 
condition (A) if: 

(A) for all t e [0T], the probability distribution 7T t has an unnormalized density q t w.r.t. the 
Lebesgue measure, and {q t , t G [0 T] } satisfies the Ito-type stochastic partial differential 
equation (Duncan-Mortensen-Zakai SPDE) 

dq t = C* q t dt + q t h dY t (2) 

in a suitable functional space, where for all t > 0, the forward diffusion operator £jf is 
defined by 

A> = -|[/,*] + ^Ml. 

for any test function <fi. 

Conditions under which (A) holds, and more general results on solutions of the DMZ-SPDE 
can be found in [11]. The corresponding MFS form of the SPDE (2) is : 

dq t = C* q t dt-\ q t \h\ 2 dt + q t h o dY t . 

It is known that in general the density q t does not evolve in a finite-dimensional parametrized 
family, say {<?(•, C)j C U C R m+1 }. In some particular cases this happens. For example, 
in the linear case (/ linear, a t (x) = a t for all x, h linear, and X with Gaussian distribution) 
qt evolves in the manifold of the unnormalized Gaussian densities. Some other examples of /, 
a and h ensuring that qt evolves in a finite-dimensional family are given in [1], [9]. Notice, 
however, that in these examples the drift / is not allowed to depend on the observation process 
Y. 

In the present paper we focus on exponential families, according to the following 

Definition 2.1 (Unnormalized exponential family) Let {c±, ■ ■ ■ ,c m } be scalar functions 
defined on R ; such that {1, c±, ■ ■ • , c m } are linearly independent, have at most polynomial growth 
and are twice continuously differentiable. Assume that the convex set 

O : = {0 G R m : V(0) = log J exp[6 T c{x)} dx < oo} , 

has non-empty interior. Then 

EU(c) = {q(-,9,P),(6,P)eU}, 

q(x;0,/3)) := exp[9 T c(x) + (3} , 

where (6, P) := [0 U 9 m , (3 } T and U C O x R is open, is called an unnormalized exponential 
family of probability densities. The m + 1 quantities (6, ft) are called the canonical parameters 
for the unnormalized exponential family EU (c) . 

Remark 2.2 Given linearly independent {ci, • • • , c m }, it may happen that the densities exp[6 T c(x)] 
are not integrable. However, it is always possible to extend the family so as to deal with inte- 
grable densities only. Indeed, since there exist K > and r > such that 

\c(x)\ < K(l + \x\ r ) , 
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for all x G R ; we can define d(x) 



EU{[c d}) := {q'(-; 6,fji,P), 6>GR m ,/i>0 ,/3gR}, 

q'(x;9,/j,(3) := exp[9 c(x) — fi d(x) + 0\ , 

is an unnormalized exponential family of densities, with a non-empty open parameter set. 

In this paper we solve the following problem. Consider the nonlinear filtering problem for the 
system (1). Suppose that the nonlinear coefficients a t (-) and h(-) are given a priori. Let be 
given an exponential family. Find a drift / = u such that the resulting filtering problem has a 
solution in the given exponential family augmented by the functions h and h 2 in the exponent. 
More precisely: 

Problem 2.3 Let be given any Lipschitz continuous (uniformly in time) diffusion coefficient 
a t (-) = cr t (-) 2 and any Lipschitz- continuous observation function h (which has at most polyno- 
mial growth). Let be given any exponential family EU{c), such that EU(c") := EU([h h 2 c T ] T ) 
is still an exponential family according to Definition 2.1. Let (CP) be the m + 3 canonical pa- 
rameters of EU(c'). Set (as comes natural) [6>i, . . . , 6 m ] = [C, . . . , C, m +2\- Let be given an initial 
condition X such that ty admits an unnormalized density go — q(~] Coj Po) ^ n the extended fam- 
ily EU(c*). Find a drift f = u such that the filtering problem for the nonlinear system (1) 
admits a finite dimensional solution q t evolving in EU([h h 2 c T } T ). 

3 Solution 

In this section we solve Problem 2.3 by mean of the following 

Theorem 3.1 ( Solution of Problem 2.3) Assumptions of Problem 2.3 in force. If the drift 
with 

C t :=Y t + Cl C t 2 :=Co-^ Q:=Q, i = 3,...,m, (3) 

satisfies (A) together with a t and h, then it solves Problem 2.3. As a consequence, for the 
resulting nonlinear filtering problem with coefficients u t , a t and h, the optimal filter is expressed 
by the density q t = q(-, (t, Po) which evolves in the finite dimensional exponential family EU(c') . 

Remark 3.2 (Sufficient conditions for (A)) For explicit conditions on u t ,a t , h and X 
under which (A) holds (and for general results on the solution of the DMZ-SPDE) see [11]. In 
our case a set of sufficient condition ensuring (A) is, as from Theorem 4-1 of [11]: 

(i) h is Lipschitz continuous; 

(ii) a t , d x a t , a t d x c* are Lipschitz continuous, uniformly in t, for j — 2, . . . , m + 2. 
(Hi) a t (x) y d x h(x) is Lipschitz continuos in (x,y), uniformly in t. 

(iv) Y = and q Xo G EU(c*). 
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PROOF of the theorem: Consider a candidate drift u t (- ;(t,Pt) and the associated forward 
differential operator 

The corresponding state equation originates the filtering problem for the system 

dX t = u t (X t ;(t,Pt)dt +a t (X t ) dW t , X 
dY t = h{X t )dt + dV t . 

In order to check under which conditions this filtering problem has solution q t = q(- ; ( t , (3 t ) we 
proceed as follows. Write the right-hand side of the DMZ-SPDE for the density q(- ; (t, A) an d 
equate it to the differential (in time) of q(- ; (t, fit) computed via the chain rule: 

^ 2 fig(-;C t ,&) odr , fig(-;C«,A) od5 i 
90 ° dCt + ^ ° d(3t 

= U t *q(-;( t ,P t )dt-lq(.;( t ,p t )\h\ 2 dt + q(- ;( t ,(3 t )h o dY t . 
By dividing both sides by q and straightforward calculations, one obtains 

m+2 Q 9 

£ c- o d£ + d(3 t = ho dY t - \h 2 dt - u t (- ; C t , A)Cf^ 



cfe 2g(.;Ct,A) &r 2 

A first step in finding curves t i— > £ t and t i— > /? t such that this equation is satisfied is to set 
(remember that c* — h, c° = h 2 ) dQ := dY t , d( 2 := —\dt. The above equation reduces then 
to the (linear) differential equation 

du t (- ;Ct,Pt) . ,T dc " , * a \ 

_ m ^^ r . a | i 0Vg(-;Ct,A)] 

* + 2 9 (. ;&,/%) 9x 2 
By solving this last equation in w one obtains (6>t as defined in Problem 2.3) 



w 4 (x; Ct, A) = \—^. — + \a t {x)( t 



9 t T ex V [-Cc'(x)] f c(z)ex V [Cc'(z)]d2 

J — oo 

-A f exp[C t T c-(z)]^ . 

J— oo 



We are free to choose the curve t h- > (6^, A) as we wish, as long as it is regular. Set 9 t := 9 for 
all t e [0 T] , and & := /3 for all i e [0 T] . □ 

4 Examples 

We present the following examples of applications of Theorem 3.1. 
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Example 4.1 Cubic observations. The present example is inspired by the cubic sensor stud- 
ied in [12], where it is proven that for the cubic sensor problem there exists no finite dimensional 
filter. Here we consider the case where the diffusion coefficient for the state equation is constant 
(say a t (x) = 1 for all t G [0, T] and x 6 Rj and with cubic observation function (h(x) = x 3 
for all x GRj. A straightforward application of Theorem 3.1 yields the following result. 
The filtering problem for the system 

dX t = [^Y t X?- 3(1 + ±t)X?]dt+ dW t , q Xo ~ exp[-x 6 ], 

dY t = X 3 dt + dV t , Y = 0, 

is finite dimensional and has conditional law with density 

Px t \y t ( x ) exp[Y t x 3 - (1 + lt)x 6 ], t G [0, T], x G R. 

Example 4.2 Linear Observations. We consider the case of linear observations. For sim- 
plicity, take h equal to the identity function. Theorem 3.1 yields the following result: The 
optimal filter for the filtering problem 

dX t = {l^(X t ) + ±a t (X t )[Y t + ^-(t + -)X t ]}dt 

OX Vq Vq 

+ a t (X t )dW t , Xo^Af^vo), a t = o], 



dY t = X t dt + dV t , Y = 0, 

is finite dimensional and has conditional law with density 

,li + Y t v v 



l + v t 1 + v t 



5 Conclusion 



It seems, at a first sight, that our result contradicts classical results on nonexistence of finite 
dimensional filters, such as for example Chaleyat-Maurel and Michel (1984) [8], and the related 
works Ocone and Pardoux (1989) [16], Levine (1991) [14]. This contradiction appears a natural 
consequence of the arbitrariness of a and h. Nonetheless, there is no real contradiction. Indeed, 
since {( t , t G [0 T] } depends on the observation process Y, the drift itself depends on 
the observations. This assumption is not allowed in the works mentioned before, and indeed 
we cannot construct a nonlinear filtering problem with prescribed (nonlinear) a and h, with 
drift u which does not depend on the observation process Y and whose solution remains finite 
dimensional. We have to allow for observations-dependent drifts in order to prove our result. 
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